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different classes, but previous grade point average and the GRE. - 
quantitative test score predict overall] student performance. better 
than any othet tested variables. (Aut hor). 
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This study attempts to assess the effectiveness of 


admission requirements such as grade point, average, GRE: test 


references, work experience and p€rsonal 
s ‘ cae . 
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scores, personal 

Howie statements in.predicting student performance in 

specific library science classes and throughout a library ; 
4 : ‘ 

schgol Master's program. it is suggested that the factors 

which predict performance best are different for different 

classef, but ee grade point average and the GRE 

ated eee test score predict overall student performance 

better ‘than any other tested variables. | ‘ 
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OPTIMIZING SELECTION ,OF LIBRARY SCHOOL as 
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BACKGROUND tp 
- A wide variety of standards is used by accredited library 
schools to select acceptable students from applicants for 
ndmiseton.?° Some iting criteria, such as undergraduate 
grade point god @ (UGPA), are used almost universally, 
while others, eh as performance in personal interviews, are 
seldom PrPpl ied. 
The selection process has two goals: rinet to choose 
potentially successful librarians, and second to aeuae: 
potentially successful graduate students. It is difficult 
to measure specific qualities which make an individual likely 
. to succeed as a librarian, especially since it is so difficult 
to define and measure the qualities of a "good" librarian. 
dats Ra{llie! and Doyle” found slight positive correlation 
between graduate grade podrit average (GGPA) and selected 
measures of library job success. To some extent then, selecting 
potentially successful students means selecting potentially 
‘successful librarians. *s 
; It is also difficult to define the qualities of a "good" 
graduate stugent. GGPA is the eek common measure of seutate 


scholastic achievement, in spite of its weaknesses.“ rt 


normally varies over such a narrow range that it can only * 


be used to discriminate between greatly different levels of 

performance, and the range of grades seems to be aaeeatas 

with time because of grade, inflation.” ) . . 
There is evidence that GGPA in individual subject depart- 


ments is predicted by several selection criteria to varying 


degrees. a4 ai Each academic department should therefore 
SS 


seek its own optimunh combination of predictors for student 


’ selection. 


UGPA is the most widely used selection device because of 


its acceptance as the best predittor of GGPA; most students 


seem to perform at ny given time much as they have in the 


YY 
past. Unfortunately it is a weak predictor. Morris stein’? 


-& 
has noted that prediction problems arise from: 1) variability 


of grading standards at different schools (strikingly illus- 


trated in.a study by Schweiker, Demaree and Shah’*), 2) homo- 


geneity of the pedaent aeane (A narrow range of values ‘normally 
correlates less well with another variable than a wide range), 
\ 
and 3) failure to allow for pe the individual. 
The second most popular selection device is student 
performance on tests such as the Graduate Record ceminaeton (GRE) . 
Hof fmann© has shown GUE eens dangers inherent in over- 


reliance on tests as predictors of student ability. willingham?’ 


: » 


observed that the GRE Advanced tests have greater validity as 


predictors than the other GRE tests or most GPA's. Examining eg a 


Q_ 


much of the literature, he found that "a weighted composite 


including undergraduate GPA and one or more GRE scores typically 
pro ides a validity coefficient in the .40-.45 range for 


various criteria of success and for different academic fields." 


Unfortunately, there mene: the few GRE Advanced test results ) 


available for the cases in this study sample to test their 


predictive ability. 
Poor prediction grom standard scholastic criteria has 
led some researchers to examine environméntal and personality 


& 


factors for possible influence on performance in school, but 
; 1 13 ; ne 
with mixed conclusions. This study disregards such 
factors as beyond its scope. 
This examination of selection criteria is intended to 
help determine the comparative values of the factors commonly 


used to select students for admission to graduate library < 


school programs, so that methods used in selection systems 


‘can be based on more than opinion or tradition. Most of the 


pertinent reports found in the literature are more than a few 
years old, pertain to other disciplines, and lack sufficient R 
details to give a reader confidence in the methodology and 


. Y 
conclusions. 
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@ THE ILDINOIS SELECTION SYSTEM 


Table I shows how values are ‘assigned to admissiog-var- 
“jables for each soald cant to the University of Illinous Graduate 
| School of Library Science (GSLS).. GPA's for the pace glee 
semester hours of college cregit Bre computed, and converted to 
a five point scale if necessary. One staff ee evaluates all 
applicants' professional statements to assure uniform grading. 
Letters of reference are treated similarly. Criteria of 


4 
"ascendancy" (See Table I.) are the most arbitrarily judged 


facfors because of their many possible variations. They have 
little impact on the point total, as few applicants are awarded 
more than five points for ascendancy. When the deadlina for 
submission of applications sehived endh year, the total number 
of points per applicant required for admission is set to a 
figure that will Satiahe the student openings at the GSLS to 
be filled. | . 

aah cdhoes criteria are aumadiad ca Sais by a GSLS 
faculty committee with heated debate and occasional revisions 
of the formula. The faculty does agree that a multiple-prediction 
test which examines the total qualifications of each applicgant 


X 


is more suitable than the assignment of rejection cutoff 


points to each variable.. 


CRITERION 


j eens Point averAue -_ Last 60 Hours 


4.0=0 5.0 = 1 : 
Multiplier = 40 1 times 40 = 40 


MAXIMUM POINTS 


* Graduate Record Examination 
SS ee 


40%ile = 0 ‘100%ile = 60 
Multiplier = .25 
Verbal and quantitative results are added. 
.25 times 60 + .25 times 60 = 30 


Foreign Language ‘ 
2 points 


1 year of high school language = 
r 1 YESE of college language = 4 points 
Maximum points = 12 


Sequences 
2 courses in science, social science, 
' humanities, elective, each worth 1 point 
Fulfilling all 4 sequenees = . 5 
Soy Paid Library Work Experience 
1.summer session full time = 4 


l year as a page Ge 4 n 
1 year full time = 12 
Maximum points = L2 
* Letters of Reference . 
Each of three letters to be rated 0 to 5 
Maximum points = 15 
* Professional Statement | + ) 
’ Rated 0 to 15 15 
Ascendancy : r 
; Leadership or participation ; 
Honors and Awards 
_ Related work experience 
Science or math majors 
- Other graduate work and degrees 
Maximum points = is 20 
TOTAL POSSIBLE POINTS, = 149 


TABLE I. GSLS ADMISSION, POINTS ASSIGNMENT. ** 


* indicates that a factor is examined in this study. 
** In 1973 different weighting factors made maximum points 
for the respective criteria 45, 36, 15, 10, 15, 30, 


10 and 15, for a possible total of 176. 
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THE STUDY 
Selection criteria used at the GSLS were examined in two .; 


stages: First for correlation with the performance of all the 

I 5% 
students in specific classes, and second for effectiveness in 
predicting total performance of Master's degree candidates in 


the GSLS. 


EVALUATION BY CLASS . 

Twelve library science classes offered in the fall 1975 
semester were examined for correlation of student devewumanion 
with, the variables used for admission criteria. The classes 
were selected as a representative sample of the courses taught 
by the regular GSLS faculty. vestenateis were asked at the 
ene of the semester to cent all the students in each class 
according to their class performance, or if that were 
impracticable, to divide ee approximately into a top, and a 
bottom half group. It was assumed that the instructors would 

’ ' 
rank the students by the same criteria that they used for, 
assigning grades. The grades themselves could not be used 
effectively pdeunae of uneven grading practices, e.g., one 
inetractey might give twenty A's and four B's while another 


did just the opposite. , . 


The population sample was not random. Some students were 


judged in more than one class while others were not judged at 


. all. ‘Some of the students were in doctoral, Certificate of 
Advanced Study and ee ae ee ae programs. Class 
size varied from six to fifty-one students. _ The small size and 


, 


uneven nature of the sample of aigaente could have permitted a 
few unusual cases to have a ja Sonate effect on Hie 
study findings. 

Numeric coefficients of correlation were, computed to 
show the relationship between the aint class eens 
ana adnt onion selection devices. The correlbtion figures were 
derived by two methods. Kendall's Tau was used when cjass 
rank g available. The biserial correlation coefficient was 
used when the class was simply divided into two groups by 
‘performance. | 

x 4 

‘Correlation coefficients are numeric heawares of how 
variables correlate or vary in relationship to each other. 
dctetabiog normally falls between +1 and 4 Wea indicating 
: total dependence and a direct relationship between variables, 
0 indicating that there is no ‘relationship between the tested 
variables, and -l indicating total dependence and an inverse 
‘relationship. The strengths of vatabtodshina shown by different 


correlation figures are not easily defined in words. Perhaps 


the best way to understand the relationship indicated by a 


. | 10 


nunber such as 0.35 or -0.6 is to examine examples in ‘basic 


« 


statistics textbooks. It is important to remember that even 
‘ s \ 


the strongest correlation does not show causality. Correlation 
ae ’ 

figures do “not indicate ifa change in one variable produces 

change in, another or if both are controlled by some third, 

dintented, factor, 

“The correlations, shown in Table II, were much a expected. 


| / 
‘The fa¢tors varied in their ability to predict success in 


® . : . | 
different classes. . UGPA was the strongest overall predictor, we 
and personal Statements and references (RECS) were weakestc 
Performance: in Automation and Audiovisual Services, the technical. 

: : 3 » 
classes, appeared to correlate best with the GRE Quantitative 
(GREQ) percentile scores, while performance in those involving 
language manipulation, such as at ouenae. correlated best with 
the” GRE Verbal (GREV), percentile scores. Unexpected were, 
1) lack of correlation between student, performance and both 
GREV and GREQ in Science Materials and Library Administration 
classes, and eee vesults for two sections of Reference 
Services in the Humanities. , c- 2f . & 
The difference between the.results for the two reference 

classes may have been caused by lack of continuity between 


instruction and testing in one of them. One instructor was 
«< 


responsible for testing and assigning grades to both sections,, 


1i 


‘Cataloging and © 


Science Materials for 
Nonspecialists | 


Library Materials 


‘for | Children 


‘Audiovisual Services 


in. Libraries. 


Library om 
Adminiatradion 


Classification. 


“Reference Service 


in the Humanities . 
and Social Sciences 


Science Reference 
Materials for 
Specialists 


Library, Automation 


Information Storage 
and Retrieval | 


Books jand Libraries 
in the Ancient and: 
Medieval World, ~. 


Contemporary Book 


ease 
TABLE II. 


‘26 


16 


a AQ mn < 
. CORRELATIONS OF PRED TSR se CLASS PERFORMANCE. 


Tau: Kendall's Tau 


“pis’ 


ot 


30%" 


-61* 
a52¥ 


-48 


-29* 
- 26* 


* .60 


Pp 


biserial Bane eee ae 


.47* 


mn: number of students in sample 


*; significant at Alpha = .10 
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but a substitute lecturer: ‘was uged in one of the sections during 


. ® 
U 


much of the Senaies: « The instructor who assigned Phe aesede 


« U { 


commented that poor morale led: to poor performance of many ’ 


. \ . 
students in the substitute-lecturer class. More students in 
; . x id f ‘ 
the substitute-lecturer class neceived low grades than in the 


other class, and the spread of grades probably reflects the 


° 


. reasons that correlation between student performance and most 
of the tested variables was stronger in the substitute's class. . 


EVALUATION BY GRADUATING GPA 


>. 


Total GSLS class performance prediction ability was 
' examined for a different sample, the Master's’ degree candidates 


who arrived in summer and fall of 1973. One hundred ten new 


» 


students were accepted and entered school. Three were dropped - 
- )- : 


from the sample because their records did not_includd GRE Scores ° 


or work-experience and letter-of-reference data. Ten part-time 
-students ieee excluded as special, cases. The ery . 
ninety-seven students' selection vartiables were “correlated with 
their geane point syepaee at the end of the 1973- 74 school : S baaag 
The results appear oa Table Iii. 

The GGPA_ computed by the University of Illinois is based 
ea eae letter grades, disregarding plus snd minus information. 


Most of the instructors at, the GSLS, BOSON aEH do assign pe 


and minus grades. To attiies the information contained in the 


= 


: 44 


GGPA 
UGPA 
GREV 
GREQ 
s WORK 
RECS 
STMT 


p< GGPA 
UGPA 
GREV 
GREQ 
WORK 
RECS 
STMT 


. TABLE III. 


; - POPULATION. PARAMETERS 
Variable Mean 


6.806 
4.455 
75.649 
- 58.237 
9.237 
22.454 
7.742 


‘ 


GGPA _—siUGPA 


1.000 0.322 
0.322 1.000 
0.167. 0.125 
0.241 0.052 


" ~0.250 ‘ -0.258 


02055 0.129 
-0.099 -0.018 


% 


Standard Deviation on. 
0.725 97 
0.322 ‘97 
17.922 97 
21.984 : 97 
6.204 97 
2.500 ie 97 
1.445 97 


CORRELATION COEFFICIENTS 


GREV 


0:167 
0.125 
1.000 
0,316 
-0.289 
-0.161 
0.138 


GREQ 
Q.241 
0.052 


. 0.316 


1.000 
-0.185 
-0.042 


70.066 


' WORK 


-0.250_ 
-0.258 
-0.289 
-0.185 
1.000. 
0.258 
0.004 


RECS 


0.055 
0.129 
-0.161 
-0.042 
0.258 
1.000 


0.157 


STMT: 


-0.099- 
-0.018 
0.138 
-0-. 066 
0.004 
0.157 
1.000 


POPULATION PARAMETERS AND COEFFICIENTS OF CORRELATION 
' FOR ENTRANCE VARIABLES AND GRADUATE GRADE POINT AVERAGE. 


GGPA: Measured on a 9-point scale (See Table Iv.). 
' UGPA: Measured on a 5-point scale. 


GREV 
GREQ 
WORK 


(See Table I.). 


RECS: Recommendations on a 30-point scale. 


Verbal test percentile, 0-99. 
Quantitative test percentile, 0-99. 
Library experience on a 15-point scale 


STMT: Personal goals statement on a 10-point scale. 


J 


° 
plus and minus grades, GGPA was recomputed, for each student 


on a scale from nine to zero, A+ to D+, ‘as shown in Table Iv. 
‘ o 7 | ? . 

All tests were duplicated using the less informative "pure" 

GGPA's provided by the University, and not surprisingly, they 


yielded results in ratid with those reported below, but )with 
/ 


lower correlations. ». P ° ; 2 
The sample was very biased’ in that it. consisted entirely 
of accepted students at one school for one particular year. . 


Twelve students had Master's degrees in other subjects, and 


‘two had the PhD degree. The greatest biasing factor was 
limitation of the’ sample to pocepted students. Since the 
independent variables were used te screen sample membership, 


aes oo foe ea ee 
their range was curtailed. erinivasan*end Weinstein 


created a model to predict how well rejected Management 


r 


4 


Ystudents would have performed, had they been admitted to a 


program. eueh a model could contribute to understanding of the 
relationships examined below. However, the model ing procedures | 
are complex, and Foe the limited conclusions to be drawn from 

‘ this sample, it was simply assumed chat obeeved correlations 
extended some distance into the unmeasured rejected-student 

. panye ce 


ee 
A multiple regression analysis was peEtorned on the data 


“4 using the Statistical Package for the Social Sciences (SPSS) 
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9 

8 

7 

6 

B 5 
4 

3 

2 

“—t 

0 


TABLE IV. GRADUATE GRADE POINT AVERAGE SCALE. 


10 


data aad on an IBM 360-75 computer. Independent 


variables which had shown. positive correlation with GGPA, 1.@s% 


undergraduate grade point average (UGPA), GRE verbal test (GREV)) , 
GRE quantitative test: (GREQ) and personal Eagamuonannrans (RECS), 
were examined to see how well they could predict GGPA. It was 
arbitrarily assumed, to simplify computation, that the variables 


were sufficiently independent of each other's influence fhat 
step-wise regression was unnecessary. | 

Most multiple regression eee Conan Sea ee 
assumptions regarding the data. It must be Lieeuval or ratio, 
be randomly selected, .and have linear padvesaion: The 
dependent variable must have apasenct variance for all combina~— 
itstie of Andependent cuniabicay, | | 


*s 


The variables in this test were all measured on a tio 


scale; they were graded at intervals frou * zero base.’ Although 
the sample was not random, it was considered to be almost the 
entjge population of one specific student eategory. 
| Visual. inspection of scatter diagrams revealed no nonlinear 
relationship between any independent variable and GGPA. Tally~” 
vesdried & similar situation in his examination ‘of GRE, UGPA 
and GGPA. 
e 


None of the scatter diagrams showed reasonable cutoff 


thresholds for applicant rejection. Setting individual cutoff : 


» 
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B- B B+ : A- | | A 0 Ke nd 
| GGPA 
, ; ¥. : 
FIGURE I. UNDERGRADUATE AND\GRADUATE GRADE ‘POINT AVERAGES. SCATTER DIAGRAM. 
- « 


“successful" students than 


~ 


thresholds would have removed more 


‘unsuccessful qnes. (In Figure I for example, note the ‘GGPA 


range of the eight students who had UGPA's below 4.0.) Bailiie® 


arrived at similar conclusions concerning cutdéffs, as did Borg? 
in an ‘examination of education students! per formance. Although 
an upper threshold did appear to exist for acceptance on the 


basis of high UGPA (The thirty-two students with UGPA above 4.6 


, 


all finished with GGPA's of B+ or higher, as illustrated in 


, Figure I. ie all students in Shae: ‘category dia sO MeEt on Other’ 


admission factots that there was no-dangér of their vatwctions 


a 


There was no case df very high UGPA with low scores “on other 


a. 
« ‘ 


variables to observe in the samples. Guliy*s study of graduate 
student performance in several departments at Florida state : 
University’ was especially important in that the sdmple 

‘ group was essentially not predetermined by the test sainbvee 
He arrived at the same basic conclusion ab others with lore 


4 
restrgbtea samples: "The multiple régression procedure for 


organizing predictive data...led to a significantly higher 
| propertion Se eetiee (acceptance and rejection) decisions 
than the multiple screen (multiple cutoffs). 7 
‘able ¥ shows Aha joint effect regression geabiorten, 
\ : 
The correlation: between GGPA and the independent variables 


was 0.399. A surprisingly small amount of the variation in 


i i 
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yy 
/ 
; ys 
' , . 
\ 
Correlation .- 0.399 DF 4,92 
(Multiple R) ; a, 
~“F¥action controlled by Ind.. Variable or ? 0.160 e F 4.367 
_" (R Square) ares a ; : 


Standard Error . xy 1 0.679. - ‘ 


“TABLE V. JOINT EFFECT OF on GREQ, AND RECS ON GGPA. 
, ; ‘ , 


tage 


? 


12 


GGPA was explained by linear regression on UGPA, GREV, GREQ: 
and RECS: R square reflected only about sixteen percent. 


. f . ° 
However, the hypothesis that none of the variability of GGPA 
P : \ % 
was determined by the independent variables would have been 
> or - 
rejected at the 99.5 percentile level. The F value was 4.367 


with four and ninety-two degrees of freedom. - i B,| Phag ; " 
Roe. . a. be ‘ : 
_anelnding the ea aire ae yatiables with negative err ae 


lations ‘(personal statements and: work ie estahicnt ‘increased 


o «x 


, correlation iguikipt R) to 0,435 and the amount ESegaeeee. by 


independent vatiables to nineteen percent (R square = 0.189). 


2 


It does not seem practical to act on the basis of those nonsig- 


nificant negative correlations, as it would increase likelihood 
of rejecting applicants with the best-written personal data 
paragraphs and most’ library work experience. 

Table VI ahewn the effect of. the spdsvaduer independent 
variables on GGPA. The equation for optimum ee based 
on that inicenatien is 

GGPA = 2.962 + .671(UGPA) + .003(GREV) + 
-007(GREQ) + .011(RECS) 
Table I specs eg the independent variables were derived. 
The average deviation from predicted GGPA for the sample, 


i.e., the standard error of estimate for the regression 


equation, was 0.679 grade point units, less than the difference 


, 
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STANDARDIZED ‘STD ERROR a8 


VARIABLE | | FACTOR OF EFFECT % OF EFFECT OF FACTOR | F DF 
: (B) a, in (BETA) 
UGPA 0.671, 0.298 0.219 9.359 1,92. 
/ + GREV ! 0.003 | 0.071 fe 4 ‘1004 - 0,479 1) 92, 
i - GREQ 0.007 » 8S 0,208 0.003 & Rae ee 
| RECS 0.011 7 0.037 00028 0.144 1, 92 
(CONSTANT) 2.962 


TABLE VI. INDIVIDUAL EFFECT OF UGPA, GREV, GREQ, AND RECS ON GGPA. 


1a 


_ betweefy a B+ and a B. © Sy 2 | . 
: ee : 


rhe beta weighs listed ‘in Table vi also show the . ae 
sseteiainnt standardized. since units. are’ Se aeatcay) the 
beta weights show Bid saute of effect contributed by each * 
of the independent variables. "Rinety-ninth pexcentt ie eetaste 
indicated that GREQ and UGPA had significant correlation with 
GGPA. RECS and GREV correlations showed no significance, even 
at the seventy-fifth percentile level. 

The GREV score's weakness'as a predictor and the GREQ's 
strength were surprising in’ light of the ‘amount sf reliance on 
written communication (assigned papers and examinat fons) for 
student assessment assumed‘ to exist a the GSLS. paillie® also 
found GREQ to have higher correlation than GREV with GPA, but ; 
one a¥ererence was much smaller: GREV = .34 and GREQ = .39. 

. The difference is difficult & account for. Perhaps students , 
eer for library school are self-sélecting to those with 7 
literary ability and uniformly- high GREV scores. : Borg? suggests 
that conection waleccicn of students with humanities backgrounds ‘ 
allows a greater, more easily measured range of student ‘ 
quantitative sbilities into graduate programs in Education. 
.It'is also possible that quantitative skills can be measured 


more accurately than verbal skills, both at GRE time and in 


- .graduate school. That might also partly account for th¢ lack 
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-of correlation found between the quality of students' written . / 
goals statement and subsequent Senne performance. r 4 
‘The slight hegative | correlation, Netuben work “experience va 


and GGPA also oeaniad hard to explain. However, when the 
seventeen students who already had graduate degrees in other ee ‘ ‘ 
subject areas wie remgved from the dipiie aha Dyerteate were 
rerun; the work experience to GGPA: rélationship changed 

" gubstantially. Multiple regression analysis was performed on > 
first the full sample wed then the sample with the graduate- 
“degree holders removed, with work experience replacing RECS 
as an independent variable in combination with UGPA, GREV and 
GREQ. The siquis: coeatat iva between work experience and GGPA 

7 eniy changed from -.250 to! - 2064 but the beta weight changed. \ 


from -.137 to -.040, and its F ratio dropped von Lie 073 to 


ne 124. Since the mean number of saan for work experience 


assigned in the melaction process Pee oars 9.700 to 9. 237, 


the comparative lack oF library work experience vamong graduates 


> 


from thar fields apparently combined with their slightly- 
mpoveravernis REEF to oithics: ‘some’ ‘of the negative torrelation ; , 


between work experience and GGPA. 
: CONCLUSIONS 


. 


-The effectiveness of the presently used criteria to 
. / . 


predict successful performance in a graduate library school 


1 
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appears to be very low. Part of the poor correlation may be 
4 ' ’ - . ; io* 


due to the biased sample used to test the predictors. Instructors 


’ 
7 


with varying sees tude; teaching styles and evaluation methods 
| doubtless contribute to" the Problem,’ as do students with « 
different classloads, subiect specializations and lewriiea’ 
goals. Concurrent classes from other departments and schools 
-may”"also have some confusing erect, | | 

.A factor which is a strong poaatcees for per formance in- 


some classes but weak in others is likely to be only moderately 
effective as a predictor Be total performance “as measured by the 
GGPA. That loss i a kes examination of performance <0 
in indiwidual classes eepactaiiy. eee in future searches | x! 
for causality and ways ‘to improve prediction. If a school 
wants to concentrate its resources on a particular line of 
study, eats Information Science.or History, finding factors 
eS nee fee te eee in specific classes could lidip éetece 
students who would be likely to: exsei in the school specialty. \ 
The literature seems to have no information or studies to ) 
-suggest this. : } 

The regression equation derived here needs to be tried on 
other samples. New samples should be used to weneents Saaneendicn 
analysis information snd Squations which could ise conned to 


| that found here. UGPA and GRE-type tests seem worthy of the 


‘ 4 
‘ a 
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most attention, but other selection factors should be examined 


unless or until there is ‘strong evidence that they are 
ineffective. 

_ There is injustice inherént in selection/of students byy, 
predictors in account for less than twenty percent of the 
likelihood of gieceegenl performance in graduate study, bit 
until better criteria are found, it is the best that can be 
done. the ony diese alternative that would yield more. 


ie 
successful students is to inteenne the number of unsuccessful 


4 


students, i.e., open enrollment to all who apply and increase > 


the failure rate. a8 


AS 
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